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Revision of P2P - Motivation 
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Revision of P2P 


wake vortex descent 
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secondary vortices weakened 
by 30 % after first round 

tertiary vortices weakened by 30 % 
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vortex-ground interaction above 0.6 b Q 
not yet further investigated 

vortex ground interaction not only 
distance but also time dependent ? 
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Revision of P2P 
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Revision of P2P 
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Multi Model Ensemble 
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How to mix several good ingredients? 


Water 

Lemon Juice 


Lemonade 


DLR.de • Chart 8 


> WakeNet 2015 > S. Korner, F. Holzapfel, N. Ahmad • Multi-Model Ensemble Wake Vortex Prediction > 12.03.2015 


Why not use the best ensemble member exclusively? 


Why not use the best ensemble member exclusively? 

• which is the best member? 

• in average best performing member can sometimes be the worst one 





Can an ensemble outperform its best member? 

• success of ensemble appr.: any model can be the best sometimes 

• consistently low performing models - no increase of skill 

Hagedorn et al., 2005 

■Pi 
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Ensemble Members 
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Multi-Model Ensemble 


Reliability Ensemble Averaging (REA) 
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Multi-Model Ensemble 


Reliability Ensemble Averaging 


R Dj depends on distance 
to ensemble mean: 
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Multi-Model Ensemble 


Reliability Ensemble Averaging uncertainty bounds: 
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Application to Wake Vortex Models 


Reliability Ensemble Averaging 


Training 

• mixture of landings from WakeFRA, 
Wake M UC and WakeOP 

• 95 selected cases 
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Application to Wake Vortex Models 
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Application to Wake Vortex Models 
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Results 


REA reliability factors (one single landing) 


RD,RB for z*, uff 


RD.RB for r*| uft 


RD,RB for y*, uff 





1 


D2P RD — 

D2PRB --- 

APA 3.2 RD 

APA 3.2 RB 

APA 3.4 RD — 

APA 3.4 RB --- 

TDP2.1 RD 

TDP 2.1 RB 


* 

t 

no correlation between 
R and R can be found! 

D B 



DLR.de • Chart 18 


> WakeNet 2015 > S. Korner, F. Holzapfel, N. Ahmad • Multi-Model Ensemble Wake Vortex Prediction > 12.03.2015 


Results 


REA forecast reliability (one single landing) 
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Results 

REA scoring 
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Results 


REA scoring 
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PDD of models and ensemble 


overconfident ensemble: 

too narrow ensemble spread 

well-dispersed ensemble: 

coverage of full spectrum of 
possible solutions 

Weigel et al., 2008, Hagedorn et al.,2004 
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Conclusion 


• ensemble can improve quality of wake vortex forecasts in average 

• however only 1.6 % improvement compared to best model 
reason: ensemble is overconfident for z* and y* 

• but: models might behave differently in particular ambient weather conditions and 
out-of-ground — investigation with pdds 
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Further Development 


• How does a good training data set look like? 

• Can the results be further improved by distinguishing various ambient weather 
conditions? 

• How does the Bayesian Model Averaging (BMA) perform? 



DLR.de • Chart 24 


> WakeNet 2015 > S. Korner, F. Holzapfel, N. Ahmad • Multi-Model Ensemble Wake Vortex Prediction > 12.03.2015 


Backup 
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Wake Vortex Predictions 
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Ensemble Methoden 

Bayesian Model Averaging 


P(B) = Wahrscheinlichkeit des Eintretens von B 
P(B|A) = Wahrscheinlichkeit fur B, unter Vorraussetzung A 


PDF = Probability Density Function (Wahrscheinlichkeitsdichtefunktion) 




Law of total probability: 

P(B) = Y, P ( B n A n) = J2 P ( A n) P ( B \ A n) 

n n 


Beispiel: 

Wir befinden uns auf einem Schiff: 

- wir wollen die Position B bestimmen 

- 3 Crew-Mitglieder (A1,A2,A3) wissen wie es geht, haben aber unterschiedliche 
Methoden 



according to Grimmett and Welsh., 1986 
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Ensemble Methoden 

Bayesian Model Averaging 
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Ensemble Methoden 

Bayesian Model Averaging 
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Ensemble Methoden 

Bayesian Model Averaging 


Law of total probability: P(B) = n ^ n ) = 

n n 


angewandt auf Vorhersage-Modelle: 

A = Modell n 

n 

Annahme: es gibt immer 
ein bestes Ensemble-Glied 

B 
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B T 

= Trainings-Daten 
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(Gewichtungsfaktor, basierend auf B T ) 
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= PDF of A n alone (Gaussian distribution, given that A n is the best forecast) 


— gewichtete Summe von Wahrscheinlichkeitsdichtefunktionen (PDFs) 
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Ensemble Methoden 

Bayesian Model Averaging 


BMA applied on 
48-h surface 
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forecast (bias 
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source: Raftery et al., 2005 
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Multi-Model Ensemble 
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Multi-Model Ensemble 
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